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Abstract 

A class of queueing networks which consist of single-server fork-join 
nodes with infinite buffers is examined to derive a representation of the 
network dynamics in terms of max-plus algebra. For the networks, we 
present a common dynamic state equation which relates the departure 
epochs of customers from the network nodes in an explicit vector form 
determined by a state transition matrix. We show how the matrix may 
be calculated from the service time of customers in the general case, 
and give examples of matrices inherent in particular networks. 
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1 Introduction 

We consider a class of queueing networks with single-server nodes and cus- 
tomers of a single class. The server at each node is supplied with an infinite 
buffer intended for customers waiting for service. There is, in general, no 
restriction on the network topology; in particular, both open and closed 
networks may be included in the class. 

In addition to the ordinary service procedure, specific fork-join opera- 
tions [TJ [2] may be performed in each node of the network. In fact, these 
operations allow customers (jobs, tasks) to be split into parts, and to be 
merged into one, when circulating through the network. 

Furthermore, we assume that there may be nodes, each distributing cus- 
tomers among a group of its downstream nodes by a regular round routing 
mechanism. Every node operating on the round routing basis passes on the 
consecutive customers to distinct nodes being assigned to each new customer 
cyclically in a fixed order. 
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Both the fork-join formalism and the above regular round routing scheme 
seem to be useful in the description of dynamical processes in a variety of 
actual systems, including production processes in manufacturing, transmis- 
sion of messages in communication networks, and parallel data processing 
in multi-processor computer systems (see, e.g., PQ). 

In this paper, the networks are examined so as to represent their dy- 
namics in terms of max-plus algebra [21 Sj • The max-plus algebra approach 
actually offers a quite compact and unified way of describing system dy- 
namics, which may provide a useful basis for both analytical study and 
simulation of queueing systems. In particular, it has been shown in [5j [6] 
that the evolution of both open and closed tandem queueing systems may 
be described by the linear algebraic equation 



where d(k) is a vector of departure epochs from the queues, T(k) is a 
matrix calculated from service times of customers, and © is an operator 
which determines the matrix- vector multiplication in the max-plus algebra. 

The purpose of this paper is to demonstrate that the network dynamics 
also allows of representation in the form of dynamic state equation ([T]). 
We start with preliminary max-plus algebra definitions and related results. 
Furthermore, we give a general description of a queueing network model, 
which is then refined to describe fork-join networks. It is shown how the 
dynamics of the networks may be represented in the form of ([1]). 

The obtained representation is extended to describe the dynamics of 
tandem queueing systems and a system with regular round routing. In 
fact, tandem systems may be treated as trivial fork-join networks, and thus 
described in the same way. To represent the system with round routing, 
which operates differently than the other networks under examination, we 
first introduce an equivalent fork-join network, and then get equation (pQ). 

2 Algebraic Definitions and Results 

We start with a brief overview of basic facts about max-plus algebra, which 
we will exploit in the representation of queueing network models in the 
subsequent sections. Further details concerning the max-plus algebra theory 
as well as its applications can be found in O El H] . 

Max-plus algebra is normally defined (see, for example, [4j) as the system 
(JR, 0, ©) , where JR = R U {e} with e = — oo, and for any x, y € JR, 



Since the new operations © and © retain most of the properties of the 
ordinary addition and multiplication, including associativity, commutativ- 
ity, and distributivity of multiplication over addition, one can perform usual 




(1) 



x © y = max(x, y) 



x © y = x + y. 
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algebraic manipulations in the max-plus algebra under the standard con- 
ventions regarding brackets and precedence of © over ©. However, the 
operation © is idempotent; that is, for any x € JR, one has x ffi x = x. 

There are the null and identity elements in this algebra, namely e and , 
which satisfy the evident conditions x©e = effix = x, and x©0 = 0©x = x, 
for any x 6 JR. The absorption rule involving £©£=£©x=e is also true 
in the algebra. 

The max-plus algebra of matrices is readily introduced in the regular 
way. Specifically, for any (n x n) -matrices X = (xij) and Y = (jjij) , the 
entries of U = X ffi Y and V = X © Y are calculated as 

n 

Uij — Xij © Uij , and Vij = J ^2 (B Xik © Vkj, 

k=i 

where Yl® stands for the iterated operation ffi. As the null element, the 
matrix 6 with all entries equal to e is taken in the algebra; the matrix 
E = diag(0, . . . , 0) with the off-diagonal entries set to e presents the identity. 

As is customary, for any square matrix X , one can define X° = E and 
XI = X © Xi- 1 = Xi- 1 ® X for all q = 1, 2, ... . Note, however, that 
idempotency in this algebra leads, in particular, to the matrix identity 

{E®X) q = E®X®---®X q . 

Many phenomena inherent in the max-plus algebra appear to be well 
explained in terms of their graph interpretations H]- To illustrate, 
consider an (n x n) -matrix X with entries x^ € JR, and note that it can 
be treated as the adjacency matrix of an oriented graph with n nodes, 
provided each entry x^ ^ e implies the existence of the arc in the 

graph, whereas X™ = e does the lack of the arc. 

Let us calculate the matrix X 2 = X © X , and denote its entries by x^ . 

(2) 

Clearly, we have x\j ^ e if and only if there exists at least one path from 
node i to node j in the graph, which consists of two arcs. Moreover, for 
any integer q > 0, the matrix X q has the entry x^ ^ e only if there is a 
path with the length q from i to j . 

Suppose that the graph associated with X is acyclic. It is clear that we 
will have X q = £ for all q > p, where p is the length of the longest path 
in the graph. Assume now the graph not to be acyclic, and then consider 
any one of its circuits. Since it is possible to construct a cyclic path of 
any length, which lies along the circuit, we conclude that X q ^ £ for all 
q=l,2,... 

Finally, we consider the implicit equation in the vector x = {x\, . . . , x n ) T , 

x = U ®x®v, (2) 

where U = (uij) and v = (v\, . . . , v n ) T are respectively given (nxn) -matrix 
and n-vector. This equation actually plays a large role in max-plus algebra 



3 



representations of dynamical systems including systems of queues [II HIE]. 
The next lemma offers particular conditions for (J2j> to be solvable, and it 
shows how the solution may be calculated. One can find a detailed analysis 
of ([2]) in the general case in [TJ. 

Lemma 1. Suppose that the entries of the matrix U and the vector v are 
either positive or equal to e. Then equation ([2]) has the unique bounded 
solution x if and only if the graph associated with the matrix U is acyclic. 
Provided that the solution exists, it is given by 

x = (E® U) p ® v, 

where p is the length of the longest path in the graph. 

The proof of the lemma may be furnished based on the above graph 
interpretation and idempotency of © . 

3 A General Network Description 

In this section, we introduce some general notations and give related defini- 
tions, which are common for all particular networks examined below. In fact, 
we consider a network with n single-server nodes and customers of a single 
class. The network topology is described by an oriented graph Q = (N, A) , 
where N = {1, . . . , n} represents the nodes, and A = {(i, j)} C N x N does 
the arcs determining the transition routes of customers. 

For every node i E N, we introduce the set of its predecessors P(i) = 
{j'l Cm) € A} and the set of its successors S(i) = € A}. In 

specific cases, there may be one of the conditions P(i) =0 and S(i) = 
encountered. Each node i with P(i) = is assumed to represent an infinite 
external arrival stream of customers; provided that S(i) = 0, it is considered 
as an output node intended to release customers from the network. 

Each node i 6 N includes a server and its buffer with infinite capacity, 
which together present a single-server queue operating under the first-come, 
first-served (FCFS) queueing discipline. At the initial time, the server at 
each node i is assumed to be free of customers, whereas in its buffer, there 
may be rj, < < oo, customers waiting for service. The value rj = oo 
is set for every node i with P(i) = 0, which represents an external arrival 
stream of customers. 

For the queue at node i, we denote the fcth arrival and departure epochs 
respectively as ai{k) and Furthermore, the service time of the kih. 

customer at server i is indicated by . We assume that > are given 
parameters for all % = 1, . . . ,n, and k = 1, 2, ... , while ai(k) and di(k) are 
considered as unknown state variables. With the condition that the network 
starts operating at time zero, it is convenient to set di(0) = 0, and di{k) = e 
for all k < , i = 1, . . . , n . 
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It is easy to set up an equation which relates the system state variables. 
In fact, the dynamics of any single-server node i with an infinite buffer, 
operating on the FCFS basis, is described as [6] 



(3) 



di(k) 


= T ik <g> 


a,i{k) © r ik ® d 


i(k-l). 


With the system state vectors 






a(k) = 


/ ai (k) 

\ a n (k) 


j , d(k) = 


I d t (k) \ 
V d n {k) ) 



and the diagonal matrix 



we may rewrite equation ([3]) in a vector form, as 
d{k) =T k ® a(k) e%®d(k 



1) 



(4) 



Clearly, to represent the dynamics of a network completely, equation dH 
should be supplemented with that determining the vector of arrival epochs, 
a(k) . The latter equation may differ for distinct networks according to 
their operation features and topology. We will give appropriate equations 
for a(k) inherent in particular networks, as well as related representations 
of the entire network dynamics in the subsequent sections. 



4 Fork-Join Queueing Networks 

The purpose of this section is to derive an algebraic representation of the 
dynamics of fork-join networks which present a quite general class of queue- 
ing network models. Since we do not impose any limitation on the network 
topology, the models under study may be considered as an extension of 
acyclic fork-join queueing networks investigated in pp. 

The distinctive feature of any fork-join network is that, in addition to the 
usual service procedure, special join and fork operations are performed in its 
nodes, respectively before and after service. The join operation is actually 
thought to cause each customer which comes into node i, not to enter the 
buffer at the server but to wait until at least one customer from every node 
j 6 P(i) arrives. As soon as these customers arrive, they, taken one from 
each preceding node, are united to be treated as being one customer which 
then enters the buffer to become a new member of the queue. 
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The fork operation at node i is initiated every time the service of a cus- 
tomer is completed; it consists in giving rise to several new customers instead 
of the original one. As many new customers appear in node i as there are 
succeeding nodes included in the set S(i). These customers simultaneously 
depart the node, each being passed to separate node j € S(i). We assume 
that the execution of fork-join operations when appropriate customers are 
available, as well as the transition of customers within and between nodes 
require no time. 

As it immediately follows from the above description of the fork-join 
operations, the kth. arrival epoch into the queue at node i is represented as 
(also, see [II [2]) 

r -ro, if poo 

a i( k ) = \ jeP(i) (5) 
I e, ifP(i) = 0- 

In order to get this equation in a vector form, we first define M = 
max{rj| ri < oo, i = 1, . . . ,n} . Now we may rewrite ([5|) as 

M n 

ai( k ) = ^ e ^ e gfi <8> dj(k - m), 

m=0 j=l 

where the numbers are determined by the condition 



0, if i € P(j) and m = rj, 
e, otherwise. 



(6) 



Let us introduce the matrices G m = \9ijj f° r each m = 0, 1, ... ,M, 
and note that G m actually presents an adjacency matrix of the partial 
graph Q m = (N, A m ), where A m = G P(j), Tj = m} . With these 

matrices, equation ([5|) may be written in the vector form 

M 

<k) = Y j9 GL®d{k-m), (7) 

m=0 

where denotes the transpose of the matrix G m . 

Furthermore, by combining equations ([!]) and ([7]), we arrive at the equa- 
tion 

d(k) = T k <8> Gl <g> d(k) ®T k ®d{k-l) 

M 

eTfcO ^ ffi G^«)d(A;-m). (8) 

m=l 

Clearly, it is actually an implicit equation in d(k) , which has the form of 
([2]), with U = 7fc<S>Gj\ Taking into account that the matrix Tk is diagonal, 
one can apply Lemma [1] to prove the following statement. 
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Theorem 2. Suppose that in the fork-join network model, the graph Qq 
associated with the matrix Gq is acyclic. Then equation ([8]) can be solved to 
produce the explicit dynamic state equation 



d ( k ) = Y,s T m(k)^d(k 



mj 



771=1 



with the state transition matrices 



Ti(k) 
T m (k) 



(E®T k ® GlY ®T fc ® G T m1 
2,...,M, 



where p is the length of the longest path in Qq . 
Finally, with the extended state vector 



d{k) 



( d(k) 
d(k - 1) 



\ d(k - M + 1) / 
one can bring equation ([9]) into the form of (HJ: 

d(k) = f(k) ®d(k-l 
where the state transition matrix is defined as 



( Tx(k) T 2 {k) 
E 8 



T M (k) \ 



E 



£ 



J 



(9) 



To conclude this section, we present an example which shows how the 
dynamics of a particular fork-join network is described based on the above 
representation. 

Example 1. We consider a network with n = 5 nodes, depicted in Fig. [IJ 
The initial numbers of customers in the network nodes are determined as 
follows: 7~i = oo , r2 = r4 = 0, and r% = r§ = 1 . 

First note that for the network, we have M = 1 . In this case, provided 
that explicit representation (0J) exists, it is just written in the form of ^j: 



d(k) = T{k)®d(k - 1) 
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Figure 1: A fork-join queueing network. 



with T(k) = Ti(fc) = {E@%® Glf ®%®{E® Gf) . 
Furthermore, by applying ^j, we may calculate 
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, G x = 
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Since the graph associated with the matrix Go is acyclic, with the length 
of its longest path p = 2, we may really describe the network dynamics 
through equation |7p. Finally, simple algebraic manipulations give 

T{k) = {E® % <g> Gl) 2 <g> % ®{E® Gl) = 

I Tlk £ £ £ £ \ 

Tlk <S) T 2k T 2k <S> T 3k T 2k ® T 3k £ £ 

£ T 3k T 3k £ £ 

Tlk 8> T 2 k ® T ik T 2k ® T 3k <8> T 4 k T 2k T 3k ® T 4k T 4k £ 
\ £ £ T 5k T 5k T 5k ) 



5 Tandem Queues 

Tandem queueing systems present networks with the simplest topology de- 
termined by graphs which include only the nodes with no more than one 
incoming and outgoing arcs. Although no fork and join operations are ac- 
tually performed in the systems, yet they may be treated as trivial fork-join 
networks and thus described using the representation proposed in the pre- 
vious section. 

Let us first consider a series of n single-server queues, depicted in Fig.[2J 
In this open tandem system, the queue labelled with 1 is assigned to rep- 
resent an infinite external arrival stream of customers, with r\ = oo. The 
buffers of servers 2 to n are assumed to be empty at the initial time, so we 
set r i = for all i = 2, . . . , n. 
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12 n 

□o — -□o — do- 

n = oo r2 = r n = 



Figure 2: Open tandem queues. 



As one can see, equation §5§ is now reduced to 



di(k) = 



di-i(k) 



if i = 1 
if 1 



Since M = 0, there is only one matrix 



/ £ 



Go 







£ / 



included in representation ([7J). It just presents an adjacency matrix of the 
graph describing the topology of the open tandem system. It is clear that 
this graph is acyclic; the length of its longest path p = n — 1 . 
Finally, with G\ = £ , equation ([9]) becomes 



We now turn to a brief discussion of closed tandem systems. In the 
system shown in Fig. [31 the customers pass through the queues consecutively 
so as to get service at each server. After their service at queue n, the 
customers return to the 1st queue for a new cycle of service. 

There is a finite number of customers in the system at the initial time; 
that is, we have < r, < oo for all % = 1, . . . , n. Note that the numbers T{ 
may all not equal since at least one customer is to be present. 

It is easy to understand that for the closed tandem system, equation © 
takes the form 



d(k) = {E®T k ® Go ) n_1 ® T k O d(k - 1) 
which may be readily rewritten in the form of JT]) with 

T(k) = (E®T k ® Gl) n - 1 ® % 
/rife e 



£ 



\ Tifc g) • • ■ ®T n k T2k 8) • ■ • ® T nk 



Tnk j 
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Figure 3: A closed tandem queueing system. 



whereas equations ([7]) and ([8j) remain unchanged. Since there is at least one 
customer in the system, the graph Qq associated with the matrix Go cannot 
coincide with the system graph Q , and so is acyclic. As a consequence, the 
conditions of Theorem [2] will be satisfied. We therefore conclude that the 
dynamics of the system is described by equation Q and thus by ([T]). 



Example 2. Let us suppose that in the system, n = 1 for all i = 1, 
Then we have Gq = £ and 



,n. 



( 



Gi 







\ 



\ £ 



Clearly, equation (EP is now written as 

d(k) =T k ®{E® G% ) ® d(k - 1) 
that is, in the form of ^ with the matrix 



T(k) = T k ®{E®Gl 



T~2k T 2 k 



V 



£ 



Tnk T n k f 



6 A System with Round Routing 



We consider an open system depicted in Fig. HI which consists of n = / + 1 
queues labeled with 0, 1, . . . , / ; queue is thought to represent an external 
arrival stream of customers. Each incoming customer has to go to one of the 
other queues, being chosen by a regular round routing mechanism. Upon 
completion of his service at the latter queue, the customer leaves the system. 

The routing mechanism working in the system requires that the customer 
which is the first to depart queue 0, go to the 1st queue, the second customer 
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1 

□o- 

n = o 

2 

□o- 

r 2 = 



□o— 

n = o 

Figure 4: A queueing system with round routing. 

do to the 2nd queue, and so on. After the Ith customer who is transferred 
to queue I, the next (I + l)st customer goes to the 1st queue once again, 
and the procedure is further repeated round and round. 

To represent the dynamics of the system, let us first replace it by an 
equivalent fork-join network. An appropriate network, which is actually 
obtained by substituting new nodes I + 1 to 21 for queue 0, is shown in 
Fig. EJ 



1 




Figure 5: An equivalent fork-join network. 

It is easy to see that, with the fcth service time at each new node i, 
i = I + 1, ... ,21, defined as 

T ik = T 0lk-2l+i, 



ro = oo 
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the fork-join network behaves in much the same way as the original system 
with regular round routing. Specifically, the overall operation of nodes 1 to 
I in these queueing systems is identical, and thus both systems produce the 
same output stream of customers. 

The dynamics of the fork-join network is described through equations 
dU and ([7]) with n = 21 and M = 1 . Taking into account that equation ([5]) 
now becomes 

{di+i(k), i£i = l,...,l, 
d 2l {k-l), ifi = Z + l, 
di_i(fc), if i = I + 2, . . . ,n, 

we may represent the matrices Go and G\ as 



G 



E, 



(Ixl) £(lxl) 
(Ixl) F(lxl) 



Gx 



(Ixl) £(lxl) 

(ixi) Hq x i^ 



where £(i x i) and En x [\ respectively denote the null and unit (I xl) -matrices, 
/ e e\ ( e e\ 



\lxl) 



(Ixl) 



e 



As it is easy to verify, the graph associated with the matrix Go is acyclic, 
with the length of its longest path p = I. In this case, one can apply 
Theorem [2] so as to obtain equation ([1]) with the state transition matrix 



T(k) = {E®T k ®G 1 



T\l 



%®{E® Gj ) 



Example 3. Let us calculate the state transition matrix T(k) for the system 
with 1 = 3. The above representation and idempotency in the max-plus 
algebra lead us to the matrix 



T(k) 





Tlk 


£ 
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£ 
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Tlk ® T 4k 




£ 
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T2k ® T4fc ® T 5k 
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T~3k 
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T 3k <g> T 4fe ® T 5k (8> T 6fc 
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Uk 
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T~4k ® T 5k 
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£ 
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Tik ® T 5k ® T 6k 
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